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DISTRIBUTED CACHING ARCHITECTURE FOR COMPUTER NETWORKS 

Reference to Related Applications 

This application is related to U.S. patent application Serial No. 09/ , entitled "Method 

and Apparatus for Economical Cache Population," (Attorney Docket "Broadspider 2") filed on the 
5 same date as this application, which is incorporated by reference. 

Field of the Invention 

The present invention relates to computer networks in general, and, more particularly, to 
techniques for caching resources at one node in a computer network for use by another node in the 
network. 

10 Background of the Invention 

When a user of the World Wide Web requests a Web page, the user must wait until the page is 
available on his or her data processing system (e.g., computer, etc.) for viewing. In general, this wait 
occurs because the request for the Web page must traverse the Internet from the user's data processing 
system to the data processing system that is the source of the page, the request must be fulfilled, and 

15 the requested page must travel back to the user's system. If the Internet is congested or the data 
processing system that is the source of the page is overwhelmed with many concurrent requests for 
pages, the wait can be considerably long. 

To shorten this wait, special data processing systems are deployed throughout the Internet that 
expedite the delivery of some Web pages. Some of these data processing systems expedite the 

20 delivery of Web pages by functioning as cache memories, which are also known as "caches." For the 
purpose of this specification, a "cache" is defined as a cache memory. For example, a cache stores 
commonly requested Web pages and thereafter enables requests for those pages to be intercepted and 
fulfilled from the cache without retrieval from the principal memory. This expedites the delivery of 
the Web page in two ways. First, a cache eliminates the need for the request to travel all of the way to 

25 the system that is the ultimate source of the page, and, therefore, eliminates some the wait associated 
with the transit. Second, a cache also reduces the number of Web page requests that must be fulfilled 
by the system that is the ultimate source of the page, and, therefore, the wait associated with 
contention for the system is eliminated. 

FIG. 1 depicts a block diagram of a computer network in the prior art in which one of the 

30 network's nodes acts as a cache for another of the nodes. Computer network 100 comprises three 
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nodes that are interconnected logically as shown. The salient characteristic of the topology of 
computer network 100 is that node 121 communicates with node 101 only through node 111, and, 
therefore, node 1 1 1 is capable of intercepting and fulfilling requests from node 121 for node 101. In 
other words, although there might be more than one physical telecommunication path between node 

5 101 and node 1 1 1 (not shown in FIG. 1) and more than one physical telecommunication path between 
node 1 1 1 and node 121 (also not shown in FIG. 1), and even a direct physical telecommunication path 
between node 101 and 121, node 1 1 1 is logically in the path between node 101 and node 121 . 

From the perspective of node 121 and node 111, node 101 actually or apparently comprises a 
vast amount of information arranged in bundles, called "resources." For the purposes of this 

10 specification, a "resource" is defined as an individually addressable bundle of information that can be 
requested by a node. For example, a resource might be an individual computer file (e.g., a World 
Wide Web page, a .gif file, a Java script, etc.) or a database record, etc. Although node 101 can 
actually comprise a vast amount of information if, for example, it is a disk farm, it can also apparently 
comprise the information if it acts as a gateway to a data network, such as the Internet. 

15 When node 101 is bombarded with a large number of concurrent requests for resources from 

node 121, node lOlmight not be able to instantaneously respond to all of the requests. Therefore, to 
reduce the average delay between when node 121 requests a resource from node 101 and when it 
receives the resource, node 111 functions as a cache for node 101. 

FIG. 2 depicts a block diagram of the salient components of node 1 1 1 in accordance with the 

20 prior art. Node 1 1 1 comprises: processor 201, memory 202, receiver 210, transmitter 211, transmitter 
213, and receiver 214. Processor 201 is either a general-purpose processor or a special-purpose 
processor that performs the functionality described herein with respect to FIG. 3. Memory 202 holds 
programs and data for processor 201 and comprises cache 203, which holds the cached resources for 
node 101. Node 111 uses receiver 210 for receiving data from node 121, transmitter 21 1 for 

25 transmitting to node 121, transmitter 2 1 3 for transmitting to node 101, and receiver 2 1 4 for receiving 
from node 121. 

FIG. 3 depicts a flowchart of the operations performed by node 121 and node 1 1 1 when 
node 121 requests a resource from node 101 and node 1 1 1 intercepts the request, acts as a cache for 
node 101, and fulfills the request, if possible, or passes the request on to node 101, if necessary. 
30 At step 301, node 1 1 1 stores one or more resources in cache 203, each of which resources is 

indexed by the resource identifier of the resource. For example, if the resource is a World Wide Web 
page (i.e., a hypertext markup language formatted file), the resource identifier might be the uniform 
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resource locator or "URL" for the page (e.g., www.amazon.com/mccullers.htm, etc.). It is not 
germane to an understanding of the prior art or the present invention why some resources are stored in 
the cache data structure and why others are not. 

At step 302, node 121 receives a resource identifier and a request for the resource. This 
5 request and resource identifier might, for example, originate with a user of node 121 as part of a World 
Wide Web browsing session (e.g., http://www.amazon.com/mccullers.htm, etc.). 

At step 303, node 121 transmits: (i) the resource identifier, and (ii) a request for the resource 
to node 1 1 1, and at step 305 node 1 1 1 attempts to retrieve the requested resource from cache 203 
using the resource identifier as the index into the cache data structure. 
10 At step 306, node 1 1 1 determines if, in fact, the requested resource is in cache 203. If it is 

(i.e., a cache "hit"), then control passes to step 309; otherwise (i.e., a cache "miss") control passes to 
step 307. 

If control passes to step 307, it means that the requested resource is not in cache 203 in 

node 1 1 1, that node 1 1 1 cannot fulfill the request itself, and, therefore, that node 1 1 1 must request the 
15 resource from node 101 . Therefore, at step 307, node 1 1 1 transmits the resource identifier and request 

for the resource identifier to node 101, and at step 308 node 111 receives the requested resource. 

When the requested resources is in cache 203, and, therefore, that steps 307 and 308 can be avoided, 

the wait that a user must tolerate between when he or she requests a Web page and when the Web page 

is provided is usually reduced. 
20 At step 309, node 1 1 1 transmits the resource to node 121, as requested, whether the requested 

resource was in cache 203 or not. 

The increasing size and complexity of the Internet, and its increasing use for transmitting 

multimedia resources has created the need for improved caching techniques. 

Summary of the Invention 

25 The present invention is a distributed caching technique for use in computer networks that 

avoids some of the costs and disadvantages associated with caching techniques in the prior art. In 
particular, the illustrative embodiment of the present invention recognizes that data processing systems 
that perform caching can be overwhelmed with the computational tasks associated with many 
concurrent requests, and, therefore, the illustrative embodiment removes some of the computational 

30 tasks away from the data processing system doing the caching to other systems that are less likely to 
be computationally burdened. Embodiments of the present invention are particularly advantageous in 
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computer networks that comprise a logical hierarchical topology. Furthermore, some embodiments of 
the present invention use hashing techniques to facilitate the storage and retrieval of cached resources. 

The illustrative embodiment of the present invention comprises: hashing at a first processor a 
first resource identifier to create a hash key, wherein the first resource identifier identifies a first 
5 resource; transmitting from the first processor to a second processor the hash key and a request for the 
first resource; and receiving at the first processor a second resource in response to the transmission of 
the hash key and the request for the first resource from the first processor to the second processor. 

Brief Description of the Drawings 

FIG. 1 depicts a block diagram of a computer network in the prior art. 
10 FIG. 2 depicts a block diagram of the salient components of one of the nodes depicted in 

FIG. 1. 

FIG. 3 depicts a flowchart of the operations performed by two of the nodes depicted in FIG. 1. 

FIG. 4 depicts a block diagram of a hierarchical computer network in accordance with the 
illustrative embodiment of the present invention. 
15 FIG. 5 depicts a block diagram of the salient components of a data processing node in 

accordance with the illustrative embodiment of the present invention. 

FIG. 6 depicts a flowchart of the first variation of the operation of the illustrative embodiment 
of the present invention. 

FIG. 7 depicts a flowchart of the second variation of the operation of the illustrative 
20 embodiment of the present invention. 

FIG. 8 depicts a flowchart of the third variation of the operation of the illustrative embodiment 
of the present invention. 

FIG. 9 depicts a flowchart of the fourth variation of the operation of the illustrative 
embodiment of the present invention. 
25 FIG. 10 depicts a flowchart of the fifth variation of the operation of the illustrative 

embodiment of the present invention. 

FIG. 1 1 depicts a flowchart of the cache population portion of the fifth variation depicted in 
FIG. 10. 

FIG. 12 depicts a flowchart of the resource retrieval portion of the fifth variation depicted in 
30 FIG. 10. 

FIG. 13 depicts a hash function in which one portion of the output is used as a first hash key 
and a second distinct portion is used as a second hash key. 
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Detailed Description 

FIG. 4 depicts a block diagram of the illustrative embodiment of the present invention, which 
comprises 12 nodes {i.e., data processing systems) that are interconnected in a computer network with 
a logical hierarchical topology. In other words, although there might be one or more physical 

5 telecommunication links (not shown) between any two nodes depicted in FIG. 4, the nodes are 
interrelated in a logical hierarchy. This point is worth reiterating; the depicted paths between the 
nodes in FIG. 4 represent the logical hierarchical relationship of the nodes and not the physical 
telecommunication links that the nodes use to communicate with each other. Therefore, the 
illustrative embodiment is well-suited for networks with dynamic routing {e.g., Internet Protocol 

10 networks, etc.). 

Although the illustrative embodiment comprises 12 data processing nodes in one particular 
hierarchy, it will be clear to those skilled in the art how to make and use embodiments of the present 
invention that comprise any number of nodes that are interconnected in any hierarchy. Furthermore, it 
will be clear to those skilled in the art how the inventions described herein are useful in any computer 

15 network with any logical topology — including those that are not hierarchical — and also to 
individual data processing systems and routers that comprise a cache memory. 

In accordance with the illustrative embodiment of the present invention, each pair of 
interconnected nodes communicate with each other, either directly or indirectly, via one or more 
physical wireline or wireless telecommunications links or both (not shown in FIG. 4). It will be clear 

20 to those skilled in the art how to make and use such telecommunications links. For the purposes of 
this specification, the term "path" refers to the logical communication between the nodes and not to 
the physical telecommunications links between the nodes. 

Because the illustrative embodiment has a hierarchical topology, several terms relating to 
hierarchies are defined so as to facilitate an unambiguous description of the illustrative embodiment. 

25 Therefore, for the purpose of this specification: 

• a "hierarchical computer network" is defined as a computer network in which there is 
only one logical communication path between any two nodes in the network, and one of 
the nodes in the network is designated as the "root." 

• a "given node" is any node in a computer network. 

30 • the "ancestral nodes" of a given node are defined as all of the nodes, if any, logically 

between the given node and the root, including the root. For example, the ancestral nodes 



- 5 of 27 - 



Broadspider 1 



of node 423 are nodes 41 1 and 401. One corollary of this definition is that the root has 
no ancestral nodes, but all other nodes have at least one ancestral node (the root). 

• the "parental node" of a given node is defined as only that node, if any, adjacent to the 
given node and in the logical path between the given node and the root. For example, the 
parental node of node 423 is node 41 1 and the parental node of node 41 1 is node 40 L 
One corollary of this definition is that the root has no parental node. A second corollary 
is that all of the nodes in the hierarchy except the root have exactly one parental node. A 
third corollary of this definition is that a parental node of a given node is also an ancestral 
node of the given node, but an ancestral node of a given node might be, but is not 
necessarily a parental node of the given node. 

• the "grandparental node" of a given node is defined as only that node, if any, adjacent 
to the parental node of the given node and in the logical path between the given node and 
the root. For example, the grandparental node of node 432 is node 41 1, and the 
grandparental node of node 425 is node 401. 

• the "lineal nodes" of a given node are defined as all of the nodes, if any, that must 
communicate through the given node to communicate with the root. For example, the 
lineal nodes of node 41 1 are nodes 421, 422, 423, 424, 431, 432, and 433. One corollary 
of this definition is that all of the nodes other than the root are lineal nodes of the root. 

• the "filial nodes" of a given node are defined as all of the nodes, if any, that must 
communicate through the given node to communicate with the root and that are adjacent 
to the given node. For example, the filial nodes of node 41 1 are nodes 421, 422, 423, 
and 424. One corollary to this definition is that a filial node of a given node is also a 
lineal node of the given node, but a lineal of a given node might be, but is not necessarily 
a filial node of the given node. 

• the "leaves" of a hierarchy are defines as those nodes that do not have any filial nodes. 
For example, the leaves in the illustrative embodiment are 

nodes 412, 422, 424, 425, 431, 432, and 433. 

In accordance with the illustrative embodiment, root node 401 actually or apparently 
comprises a vast amount of information, arranged in bundles called "resources," that are individually 
addressable and that can be individually requested by some or all of the nodes in hierarchical 
network 400. For example, root node 401 can be a disk farm or a gateway to a data network (not 
shown in FIG. 4), such as the Internet, that itself comprises some or all of the resources. In 
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accordance with the illustrative embodiment, each resource is a file (e.g., a World Wide Web page, a 
.gif file, a Java script, etc.). It will be clear to those skilled in the art how to make and use 
embodiments of the present invention in which a resource is something other than a file. 

For the purposes of this specification, a "resource identifier" is defined as the indicium of a 

5 resource. In accordance with the illustrative embodiment, each resource identifier is a uniform 
resource locator (e.g., www.amazon.com/books/1 02-8956393, etc\ which is commonly called a 
"URL." It will be clear to those skilled in the art how to make and use embodiments of the present 
invention in which a resource identifier is something other than a URL. 

In accordance with the illustrative embodiment of the present invention, some or all of the 

10 nodes in the illustrative embodiment generate requests for resources that are originally available via 
root node 401. Some of these requests might be instigated by a user associated of a node and some of 
the requests might be instigated by a node itself. Typically, the leaf nodes are the nodes that originally 
generate the requests because the leaf nodes are typically those that interact most often with end-users. 
Because root node 401 might be bombarded with many concurrent requests for resources, it is 

15 typically not able to instantaneously provide a requested resource. And because any delay between the 
time when a node requests a resource and when the node receives the resource is generally 
undesirable, the illustrative embodiment advantageously incorporates caches for reducing the average 
delay. In accordance with the illustrative embodiment of the present invention, each node 
advantageously acts as a cache for its lineal nodes. 

20 FIG. 5 depicts a block diagram of the salient components of a data processing node in 

accordance with the illustrative embodiment of the present invention. Each data processing node 
comprises: processor 501, memory 502, cache 503, transmitter 513, receiver 514, receivers 510-1 
through 510-«, and transmitters 511-1 through 51 \-n. 

Processor 501 is advantageously a general-purpose processor or a special-purpose processor 

25 that performs the functionality described herein and with respect to FIGs. 6 though 10. Memory 502 
holds programs and data for processor 501 , and cache 503. It will be clear to those skilled in the art 
that memory 502 can utilize any storage technology (e.g., semiconductor RAM, magnetic hard disk, 
optical disk, etc.) or combination of storage technologies, and it will also be clear to those skilled in 
the art that memory 502 can comprise a plurality of memories with different memory spaces. 

30 All nodes, including root node 401 if it is a gateway to a data network, comprise: transmitter 

513 for transmitting data to its parental node (or to the data network in the case of the root node) and 
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receiver 514 for receiving data from its parental node (or from the data network in the case of the root 
node). It will be clear to those skilled in the art how to make and use transmitter 5 1 3 and receiver 5 1 4. 

All nodes, except the leaves, comprise: one or more receivers 510-/ and one or more 
transmitters 511-/ for communicating with each of the node's n filial nodes, where / - 1 to «. It will be 
5 clear to those skilled in the art how to make and use receivers 510-1 through 510-« and transmitters 
511-1 through 51 

In the prior art and as described in FIGs. 1 through 3, the node that requests a resource 
(hereinafter the "requesting node ") from a node that caches that resource (hereinafter the "serving 
node") merely presents the serving node with the resource identifier for the resource. Thereafter, the 
10 serving node uses the resource identifier as the index into the cache data structure to retrieve the 
resource. 

In contrast, the illustrative embodiment uses not the resource identifier as the index into the 
cache data structure, but a hash key that is based on the resource identifier as the index into the cache 
data structure. Although the advantages of using hashing and hash keys are well known, one of the 

15 principal disadvantages of hashing and hash keys in the prior art is that the serving node bears the 

burden of hashing each resource identifier. This can be computationally burdensome and can slow the 
response time of the serving node. Furthermore, if a node has tens or hundreds or thousands of filial 
nodes, each of which is continually requesting resources from the serving node, the serving node's 
computational resources can be overwhelmed. 

20 Therefore, in accordance with the illustrative embodiment of the present invention, each given 

node is responsible for hashing each resource identifier and transmitting the hashed resource identifier 
to its parental node with a request for the resource. This has the advantage of distributing the 
computational task of hashing the resource identifiers down to lineal nodes, which are more likely to 
have spare computationally capacity than is the serving node. 

25 For the purposes of this specification, the term "hash function" is defined as a mathematical 

transformation of an argument into a resultant, which for the purposes of this specification is called a 
"hash key." 

FIGs. 6 through 9 each depict a flowchart of a different variation of the operation of the 
illustrative embodiment of the present invention. Each variation has different advantages and 
30 disadvantages and those will be discussed during the course of the discussion of each variation. 
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FIG. 6 depicts a flowchart of the first variation of the operation of the illustrative embodiment 
of the present invention, in which a given node, hereinafter called the "Given Node" requests a 
resource from its parental node, hereinafter called the "Parental Node" 
At step 601, the Parental Node stores in cache 503: 
5 i. the resource, and 

ii. the resource identifier for the resource 
in a data structure that is indexed by a hash key that is a hash function of the resource identifier of the 
resource. 

As is discussed below, the purpose of storing the resource identifier in the data structure along 
10 with the resource itself is to enable the illustrative embodiment to resolve hashing collisions when an 
imperfect hash function is employed. 

It will be clear to those skilled in the art how to make and use the hash function to generate 
hash keys, whether perfect or not, and the data structure, whether or not it incorporates a collision 
resolution mechanism (e.g., rehashing, external chaining, etc.). 
15 Table 1 depicts a portion of a data structure in accordance with the illustrative embodiment of 

the present invention that stores a plurality of resources and their associated resource identifiers and 
that is indexed by a hash function of the resource identifier. 



Hash Key 
(table index) 


Resource 


Resource Identifier 








hash key i 


resource i 


resource identifier / 


hash key i+1 


resource j+1 


resource identifier i+1 


hash key i+2 


resource i+2 


resource identifier i+2 









Table 1 — First Variation of Data Structure in Cache 503 



The predicate events that cause the parental node to store the resource and the resource identifier in the 
20 data structure are not germane to a present understanding of the present invention but can include, for 
example, a prior request for the resource by the Given Node or by a lineal node of the Given Node or 
by a lineal node of the Parental Node. It will be clear to those skilled in the art, however, that the 
present invention can be combined with the cache population techniques described in applicants' co- 
pending U.S. patent application Serial No. 09/ ? entitled "Method and Apparatus for Economical 

25 Cache Population." Once the resource and the resource identifier are stored in the data structure, they 
can be provided to the Given Node upon request. 
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In some embodiments of the present invention, as part of step 60 1, the hash key is also stored 
in a list of valid hash keys in the Given Node when the cache is initially populated with the resource, 
and the hash key is transmitted in step 604 only when the hash key generated in step 603 below is 
contained within the list of valid hash keys in the Given Node. 
5 At step 602, the Given Node receives a resource identifier and a request for the resource. This 

request and resource identifier might, for example, originate with a user of the Given Node as part of a 
World Wide Web browsing session (e.g., http://www.amazon.com/mccullers.htm, etc.). As another 
example, the request and resource identifier can originate with a lineal node of the Given Node, in 
which case the Given Node might retrieve the resource and store it and its resource identifier in its own 
10 cache. 

At step 603, the Given Node hashes the resource identifier with a hash function to create a 
hash key. Advantageously the hash function used in step 603 is a compatible hash function that is 
used in step 601 by the Parental Node when creating the hash key for the resource. 

At step 604, the Given Node transmits: 
15 i. the resource identifier, 

ii. the hash key, and 

iii. a request for the resource 
to the Parental Node. 

At step 605, the Parental Node receives: 
20 i. the resource identifier, 

ii. the hash key, and 

iii. a request for the resource 

from the Given Node. It should be understood that the request for the resource can be either explicit or 
implicit. For example, an explicit request might comprise a command code that accompanies the 
25 resource identifier and the hash key and that is to be interpreted as a request for the resource associated 
with the resource identifier and the hash key. Alternatively, an implicit request might be assumed 
whenever the Parental Node merely receives a resource identifier or a hash key or both from the Given 
Node. 

At step 606, the Parental Node uses the hash key it received in step 605 as an index into the 
30 data structure to retrieve the resource and resource identifier. If the data structure incorporates a hash 
collision resolution mechanism and there are multiple resources and resource identifiers in the data 
structure with the same hash key as the index, each pair of resources and resource identifiers is 
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retrieved. Alternatively, in some embodiments of the present invention in which there are multiple 
resources and resource identifiers in the data structure that are indexed with the same hash key, the 
alternative embodiments iterate between retrieving one pair of resources and resource identifiers and 
checking (in step 607) whether the requested resource is found until it is found (i.e., a cache hit) or 

5 until there are no more resources in the data structure indexed with that hash key (i.e., a cache miss). 

At step 607, the Parental Node compares the resource identifier received from the Given Node 
in step 605 against the resource identifiers retrieved in step 606 to: (i) identify which, if any, of the 
resources retrieved in step 606 are, in fact, the requested resource, and (ii) ascertain if the requested 
resource is in the Parental Node's cache data structure. If, based on a comparison of the resource 

10 identifiers, the requested resource is found in the Parental Node's cache data structure, control passes 
to step 610. Alternatively, control passes to step 608. 

At step 608, the Parental Node begins the process, which is completed in step 609, of 
retrieving the requested resource from its parental node, hereinafter the "Grandparental Node" 
because the requested resource is not within the Parental Node's cache data structure. 

15 Advantageously, the Parental Node retrieves the requested resource from its parental node in the same 
manner that the Given Node did from the Parental Node. In other words, step 608 for the Parental 
Node is identical to step 604 for the Given Node in that the Parental Node advantageously transmits: 

i. the resource identifier, 

ii. the hash key, and 

20 iii. a request for the resource 

to its parental node. In this way, steps 604 through 61 1 in FIG. 6 are recursive up through the 

hierarchy until the requested resource is found. 

At step 609, the Parental Node receives the requested resource from the Grandparental Node. 

As part of step 609, the Parental Node might store the resource and its resource identifier in the data 
25 structure indexed by the hash function of the resource identifier, or it might not. Furthermore, step 

609 for the Parental Node is advantageously identical to step 611 for the Given Node. It will be clear 

to those skilled in the art, how to accomplish step 609. 

At step 610, the Parental Node transmits the resource to the Given Node, and at step 61 1, the 

Given Node receives the resource. 
30 FIG. 7 depicts a flowchart of the second variation of the operation of the illustrative 

embodiment of the present invention, in which a given node, hereinafter called the "Given Node" 
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requests a resource from its parental node, hereinafter called the "Parental Node" The second 
variation differs from the first variation in that it is the Given Node and not the Parental Node that: 
L resolves hash collisions, 

iL determines if the Parental Node has provided the requested resource, and 
5 iii. initiates the retrieval of the requested resource from its Grandparental Node if the 

Parental Node has not provided the requested resource. 
The second variation is advantageous over the first variation in that the computational task of 
resolving hash collisions is moved from the Parental Node, which might be computationally taxed, to 
the Given Node, which is more likely than the Parental Node to have spare computational capacity. 
10 At step 701 , the Parental Node stores in cache 503: 

i. the resource, and 

ii. the resource identifier of the resource 

in a data structure that is indexed by a hash key that is a hash function of the resource identifier of the 
resource. Step 701 is advantageously identical to step 601 in FIG. 6. 
15 At step 702, the Given Node receives a resource identifier and a request for the resource 

identifier. Step 702 is advantageously identical to step 602 in FIG. 6. 

At step 703, the Given Node hashes the resource identifier with a hash function to create a 
hash key. Advantageously, the hash function used in step 703 is identical to, or is at least is 
compatible with, the hash function used in step 701. Step 703 is advantageously identical to step 603 
20 in FIG. 6. 

At step 704, the Given Node transmits: 

i. the hash key, and 

ii. a request for the resource 

to the Parental Node. In contrast to step 604 in FIG. 6, in step 704 it is not necessary that the Given 
25 Node transmit the resource identifier to the Parental Node. 
At step 705, the Parental Node receives: 

i. the hash key, and 

ii. a request for the resource 

from the Given Node. In contrast to step 605 in FIG. 6, in step 705, it is not necessary that the 
30 resource identifier be received by the Parental Node. It should be understood that the request for the 
resource can be either explicit or implicit. For example, an explicit request might comprise a 
command code that accompanies the hash key and that is to be interpreted as a request for the resource 
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associated with the hash key. Alternatively, an implicit request might be assumed whenever the 

Parental Node merely receives a hash key from the Given Node. 

At step 706, the Parental Node uses the hash key it received in step 705 as an index into the 

data structure to retrieve the resource and resource identifier. If the data structure incorporates a hash 
5 collision resolution mechanism and there are multiple resources and resource identifiers in the data 

structure with the same hash key as the index, each pair of resources and resource identifiers is 

retrieved. Alternatively, in some embodiments of the present invention in which there are multiple 

resources and resource identifiers in the data structure that are indexed with the same hash key, the 

alternative embodiments iterate between retrieving one pair of resources and resource identifiers and 
10 checking whether the requested resource is found until it is found (i.e., a cache hit) or until there are no 

more resources in the data structure indexed with that hash key (i.e., a cache miss). Step 706 is 

advantageously identical to step 606 in FIG. 6. 

At step 707, the Parental Node transmits each pair of resources and resource identifiers it 

retrieves in step 706, if there are any, to the Given Node. 
15 At step 708, the Given Node receives each pair of resources and resource identifiers 

transmitted in step 707. 

At step 709, the Given Node compares the resource identifier received in step 702 against the 

resource identifiers received in step 708 to: (i) identify which, if any, of the resources retrieved in step 

706 are, in fact, the requested resource, and (ii) ascertain if the requested resource is in the Parental 
20 Node's data structure. If, based on a comparison of the resource identifiers, the requested resource is 

has been received, then control passes to step 710. Alternatively, control passes to step 711. 
At step 710, the received resource is verified and the process ends. 

At step 71 1 and 712, the Given Node and the Parental Node cooperate to retrieve the resource 
from the Grandparental Node based on the resource identifier. It will be clear to those skilled in the 
25 art how to accomplish steps 71 1 and 712. As part of steps 71 1 and 712, the Parental Node might store 
the resource and its resource identifier in the data structure as indexed by the hash function of the 
resource identifier, or it might not. 

FIG. 8 depicts a flowchart of the third variation of the operation of the illustrative 
embodiment, in which a given node, hereinafter called the "Given Node" requests a resource from its 
30 parental node, hereinafter called the "Parental Node" The third variation is like the first variation in 
that it is the Parental Node that: 

i. resolves hash collisions, and 
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ii. unilaterally initiates the retrieval of the requested resource from its parental node, 
hereinafter called the "Grandparental Node'' if the Parental Node does not have 
it. 

The salient difference between the third variation and the first variation is that the third variation uses 
5 two different hash keys, both of which are based on the resource identifier. The second hash key is 
used as the index into the cache data structure, as in the first and second variations, and the first hash 
key is used to resolve hash collisions, whereas in the first and second variations the resource identifier 
itself is used to resolve hash collisions. An advantage of the third variation over the first variation is 
that the character length of the first hash key is known and fixed, and, therefore, the computational 
10 complexity of the hash collision resolution comparison is known and fixed. A disadvantage of the 
third variation over the first variation is that it requires the Given Node to perform two distinct hash 
functions (or one larger one whose output is bifurcated into two keys) rather than just one. 
At step 801, the Parental Node stores in cache 503: 
i. the resource, and 
15 ii. a first hash key based on the resource identifier 

in a data structure that is indexed by a second hash key that is also hash function of the 
resource identifier. The first hash key and the second hash key can be generated by either: (1) 
different hash functions, or, (2) as depicted in FIG. 13, by one hash function in which one portion of 
the output is used as the first hash key and a second distinct portion is used as the second hash key. At 
20 step 802, the Given Node receives a resource identifier and a request for the resource identifier. Step 
802 is advantageously identical to step 602 in FIG. 6. 

At step 803, the Given Node hashes the resource identifier to create a first hash key and a 
second hash key. Advantageously, the hash functions) used to create the first hash key and the 
second hash key in step 803 are identical to, or is at least is compatible with, the hash functions) used 
25 to create the first hash key and the second hash key in step 801. 
At step 804, the Given Node transmits: 

i. the first hash key, 

ii. the second hash key, 

iii. the resource identifier, and 
30 iv. a request for the resource 

to the Parental Node. In contrast to step 604 in FIG. 6, in step 804 the first hash key, which is used by 
the Parental Node to resolve collisions, is transmitted to the Parental Node in addition to the resource 
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identifier, which in the embodiment depicted in FIG. 6 was used by the Parental Node to resolve 
collisions. Therefore, it might initially appear wasteful for the Given Node to transmit both the first 
hash key and the resource identifier to the Parental Node, but it is not. The reason that the resource 
identifier is transmitted is because an ancestral node (e.g., the root node, etc.) of the Parental Node 

5 might need to use it to acquire the resource if it is not contained in its own cache data structure. This 
is, for example, true where root node 401 is a gateway to a data network that requires the resource 
identifier to identify the resource. 

At step 805, the Parental Node receives: 
i. the first hash key, 

10 ii. the second hash key, 

iii. the resource identifier, and 

iv. a request for the resource 

from the Given Node. In contrast to step 605 in FIG. 6, in step 705, the first hash key is received by 
the Parental Node the Parental Node in addition to the resource identifier. It should be understood 

15 that the request for the resource can be either explicit or implicit. For example, an explicit request 
might comprise a command code that accompanies the resource identifier, the first hash key, and the 
second hash key and that is to be interpreted as a request for the resource associated with the resource 
identifier, the first hash key, and the second hash key. Alternatively, an implicit request might be 
assumed whenever the Parental Node merely receives a second hash key from the Given Node. 

20 At step 806, the Parental Node uses the second hash key it received in step 805 as an index 

into the data structure to retrieve the resource and first hash key. If the data structure incorporates a 
hash collision resolution mechanism and there are multiple resources and first hash keys in the data 
structure with the same second hash key as the index, each pair of resources and first hash keys is 
retrieved. Alternatively, in some embodiments of the present invention in which there are multiple 

25 resources and resource identifiers in the data structure that are indexed with the same hash key, the 
alternative embodiments iterate between retrieving one pair of resources and resource identifiers and 
checking (in step 807) whether the requested resource is found until it is found (Le. 9 a cache hit) or 
until there are no more resources in the data structure indexed with that hash key (i.e. , a cache miss). 
At step 807, the Parental Node compares the first hash key received in step 805 against the 

30 first hash key(s) retrieved in step 806 to: (i) identify which, if any, of the resources retrieved in step 
806 are, in fact, the requested resource, and (ii) ascertain if the requested resource is in the Parental 
Node's data structure. If, based on a comparison of the first hash keys, the requested resource is found 
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in the Parental Node's cache data structure, control passes to step 810. Alternatively, control passes to 
step 808. 

At step 808, the Parental Node begins the process, which is completed in step 809, of 
retrieving the requested resource from its parental node, hereinafter the "Grandparental Node" 
5 because the requested resource is not within its data structure. Advantageously, the Parental Node 
retrieves the requested resource from the Grandparental Node in the same manner that the Given Node 
did from the Parental Node. In other words, step 808 for the Parental Node is identical to step 804 for 
the Given Node in that the Parental Node advantageously transmits: 
i. the first hash key, 
10 ii. the second hash key, 

iii. the resource identifier, and 

iv. a request for the resource 

to its parental node. In this way, steps 804 through 811 depicted in FIG. 8 are recursive throughout the 
entire hierarchical computer network until the requested resource is found. 

15 At step 809, the Parental Node receives the requested resource from the Grandparental Node. 

As part of step 809, the Parental Node might store the resource and its resource identifier in the data 
structure as indexed by the hash function of the resource identifier, or it might not. Furthermore, step 
809 for the Parental Node is advantageously identical to step 81 1 for the Given Node. It will be clear 
to those skilled in the art, how to accomplish step 809. 

20 At step 810, the Parental Node transmits the resource to the Given Node, and at step 81 1, the 

Given Node receives the resource. 

FIG. 9 depicts a flowchart of the fourth variation of the operation of the illustrative 
embodiment of the present invention, in which a given node, hereinafter called the "Given Node" 
requests a resource from its parental node, hereinafter called the "Parental Node" The fourth 

25 variation differs from the third variation in that it is the Given Node that: 

i. resolves hash collisions, 

ii. determines if the Parental Node has provided the requested resource, and 

iii. initiates the retrieval of the requested resource from its Grandparental Node if the 
Parental Node has not provided the requested resource. 

30 The fourth variation is advantageous over the third variation because the computational task of 

resolving hash collisions is moved from the Parental Node, which might be computationally taxed, to 
the Given Node, which is more likely than the Parental Node to have spare computational capacity. 
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At step 901, the Parental Node stores in cache 503: 

i. the resource, and 

ii. a first hash key based on the resource identifier of the resource 

in a data structure that is indexed by a second hash key that is also hash function of the resource 
5 identifier of the resource. Step 901 is advantageously identical to step 801 in FIG. 8. 

At step 902, the Given Node receives a resource identifier and a request for the resource 
identifier. Step 902 is advantageously identical to step 802 in FIG. 8. 

At step 903, the Given Node hashes the resource identifier with to create a first hash key and a 
second hash key. Advantageously, the hash functions) used to create the first hash key and the 
10 second hash key in step 903 are identical to, or is at least is compatible with, the hash functions) used 
to create the first hash key and the second hash key in step 90L Step 903 is advantageously identical 
to step 803 in FIG. 8. 

At step 904, the Given Node transmits: 
i. the second hash key, 
15 ii. a request for the resource 

to the Parental Node. In contrast to step 804 in FIG. 8, in step 904 it is not necessary that the Given 
Node transmit the resource identifier or the first hash key to the Parental Node. 
At step 905, the Parental Node receives: 
i. the second hash key, 
20 ii. a request for the resource 

from the Given Node. In contrast to step 805 in FIG. 8, in step 905, it is not necessary that either the 
resource identifier or the first hash key be received by the Parental Node. It should be understood that 
the request for the resource can be either explicit or implicit. For example, an explicit request might 
comprise a command code that accompanies the second hash key and that is to be interpreted as a 
25 request for the resource associated with the second hash key. Alternatively, an implicit request might 
be assumed whenever the Parental Node merely receives a second hash key from the Given Node. At 
step 906, the Parental Node uses the second hash key it received in step 805 as an index into the data 
structure to retrieve the resource and first hash key. If the data structure incorporates a hash collision 
resolution mechanism and there are multiple resources and first hash keys in the data structure with the 
30 same second hash key as the index, each pair of resources and first hash keys is retrieved. 

Alternatively, in some embodiments of the present invention in which there are multiple resources and 
resource identifiers in the data structure that are indexed with the same hash key, the alternative 
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embodiments iterate between retrieving one pair of resources and resource identifiers and checking 
whether the requested resource is found until it is found (i.e., a cache hit) or until there are no more 
resources in the data structure indexed with that hash key <7,e, a cache miss). Step 906 is 
advantageously identical to step 806 in FIG. 8. 

At step 907, the Parental Node transmits each pair of resources and resource identifiers it 
retrieves in step 906, if there are any, to the Given Node. 

At step 908, the Given Node receives each pair of resources and resource identifiers 
transmitted in step 907. 

At step 909, the Given Node compares the first hashed key created in step 903 against the first 
hashed keys received in step 908 to: (i) identify which, if any, of the resources retrieved in step 906 
are, in fact, the requested resource, and (ii) ascertain if the requested resource is in the Parental Node's 
data structure. If, based on a comparison of the first hashed keys, the requested resource is available, 
then control passes to step 910. Alternatively, control passes to step 91 1 . 

At step 910, the received resource is verified and the process ends. 

At step 91 1 and 912, the Given Node and the Parental Node cooperate to retrieve the resource 
from the Grandparental Node based on the resource identifier. It will be clear to those skilled in the 
art how to accomplish steps 911 and 912. As part of steps 911 and 912, the Parental Node might store 
the resource and its resource identifier in the data structure as indexed by the hash function of the 
resource identifier, or it might not. 

FIG. 10 depicts a flowchart of the fifth variation of the operation of the illustrative 
embodiment of the present invention, in which a given node, hereinafter called the "Given Node" 
requests a resource from its parental node, hereinafter called the "Parental Node." 

The fifth variation differs from the first four variations in that the Given Node comprises a 
"Table of Cached Resources," which is a table that indicates which hash keys that the Given Node 
might generate correspond to resources that have been already cached in the Parental Node. In other 
words, the Given Node is capable of conclusively determining if the Parental Node's cache does not 
contain a resource corresponding to a given hash key, and, therefore should retrieve the resource 
directly. It should be understood, however, that the converse is not true. The Table of Cached 
Resources merely indicates that a resource corresponding to a given hash key is cached, but not that it 
is the resource corresponding to the resource identifier. This asymmetry results because different 
resource identifiers that represent different resources can hash to the same hash key. 

In accordance with the fifth variation, it is the Given Node that: 
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iv. resolves hash collisions, 

v. determines if the Parental Node has provided the requested resource, and 

vi. initiates the retrieval of the requested resource from its Grandparental Node if the 
Parental Node has not provided the requested resource. 

Furthermore, in the fifth variation, it is the Given Node that bears the ultimate responsibility 
for ensuring that a resource, however and from whomever retrieved, is the resource corresponding to 
the resource identifier. The fifth variation is advantageous because many of the computational tasks 
are performed by the Given Node, which is more likely than the Parental Node to have spare 
computational capacity. 

As shown in FIG. 10, the fifth variation comprises two macro steps: cache population 1001 
and resource retrieval 1002. In accordance with the macro step of cache population, one or more 
resources and their associated resource identifiers are stored in the Parental Node's cache using a hash 
function of each resource identifier as the index as illustrated in Table 1, above. 

In accordance with the macro step of resource retrieval, the Given Node: (1) receives a request 
for a resource, (2) determines if the Parental Node might have the resource in its cache, (3) requests 
the resource from the Parental Node, if it might be there, (4) determines if the requested resource has 
been received from the Parental Node, and (5) retrieves the resource directly from the Grandparental 
Node, if the resource is unavailable from the Parental Node. The macro step of cache population is 
described in detail in FIG. 1 1, and the macro step of resource retrieval is described in detail in FIG. 12. 

At step 1 101 in FIG. 1, the Parental Node stores in cache 503: 

iii. one or more resources, and 

iv. the resource identifier associated with each resource 

in a data structure that is indexed by a hash key that is a hash function of the resource 
identifier of the resource. The result of step 1 101 is a table such as that depicted in Table 1, above. 
Step 1 101 is advantageously identical to step 601 in FIG. 6. 

At step 1 102, the Parental Node transmits an indicium of each hash key that points to a 
resource stored in cache 503 to the Given Node. The indicium can be, for example, either the hash key 
itself or the resource identifier that is associated with the hash key or a single bit entry in a bit vector 
of all possible hash keys. 

At step 1 103, the Given Node receives the indicium of each hash key, and, at step 1 104 stores 
it in a "Table of Cached Resources." Table 2 depicts an illustrative Table of Cached Resources that is 
a listing of the hash keys that point to cached resources in cache 503. 
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Cached Resources 

397 
792 
1044 

~ 7345 

Table 2 — First Illustrative Table of Cached Resources 

Table 3 depicts an illustrative Table of Cached Resources that is a bit-vector of the hash keys 
that point to cached resources in cache 503. 



Index 


Resource Cached? 


0 


Yes 


1 


No 


2 


Yes 


3 


No 


4 


No 


5 


No 


6 


Yes 







Table 3 — Second Illustrative Table of Cached Resources 

5 Regardless of the data structure used to represent the Table of Cache Resources, the Table enables the 
Given Node to conclusively determine, as stated above, whether a specific resource is not stored in 
cache 503. 

At step 1201 in FIG. 12, the macro step of resource retrieval begins. At step 1201, the Given 
Node receives a resource identifier and a request for the resource. This request and resource identifier 

10 might, for example, originate with a user of the Given Node as part of a World Wide Web browsing 
session (e.g. 9 http://www.amazon.com/mccullers.htm, etc.). As another example, the request and 
resource identifier can originate with a lineal node of the Given Node, in which case the Given Node 
might retrieve the resource and store it and its resource identifier in its own cache. Step 1201 is 
advantageously identical to step 602. 

15 At step 1202, the Given Node hashes the resource identifier with a hash function to create a 

hash key. Advantageously the hash function used in step 603 is a compatible hash function that is 
used in step 1 101 by the Parental Node when creating the hash key for the resource. 

At step 1203, the Given Node determines if the hash key created in step 1202 and the Table of 
Cache Resources indicates that the requested resource might be stored in the Parental Node's cache. If 

20 the inquiry determines that it might be, then control passes to step 1204; otherwise control passes to 
step 1210. 
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At step 1204, the Given Node transmits: 

i. the hash key, and 

ii. a request for the resource 
to the Parental Node, 

5 At step 1205, the Parental Node receives: 

i. the hash key, and 

ii. a request for the resource 

from the Given Node. It should be understood that the request for the resource can be either explicit or 
implicit. 

10 At step 1206, the Parental Node uses the hash key it received in step 1205 as an index into the 

data structure to retrieve the resource and resource identifier. If the data structure incorporates a hash 
collision resolution mechanism and there are multiple resources and resource identifiers in the data 
structure with the same hash key as the index, each pair of resources and resource identifiers is 
retrieved. 

1 5 At step 1 207, the Parental Node transmits each pair of resources and resource identifiers 

retrieved from the cache in step 1206. 

At step 1208, the Given Node receives each pair of resources and resource identifiers 
transmitted in step 1207. 

At step 1209, the Given Node compares the resource identifier received in step 1201 to the 
20 resource identifiers received in step 1208 to determine if one of the resources received in step 1208 is 
the requested resource. If the comparison indicates that the requested resource was received, then the 
process stops; otherwise, control passes to step 1210. 

At step 1210, the Given Node retrieves the requested resource directly based on the resource 
identifier. 

25 At step 1 2 1 1 , the Parental Node notes the request for the requested resource and assists, if 

necessary or advantageous, the Given Node in retrieving the requested resource from the 
Grandparental Node. It is advantageous that the Parental Node notes the request for the requested 
resource because it might affect the Parental Node's decision of whether to cache that resource in 
cache 503 in the future. 

30 At step 1212, the Parental Node considers caching the requested resource so that the next time 

it is requested, it is available. 
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It is to be understood that the above-described embodiments are merely illustrative of the 
present invention and that many variations of the above-described embodiments can be devised by 
those skilled in the art without departing from the scope of the invention. It is therefore intended that 
such variations be included within the scope of the following claims and their equivalents. 

What is claimed is: 
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